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ABSTRACT ‘ ‘ ake . ' \ 
Program vortrayal is one way of addressing the need é 

foy increased descriptive capability in evaluation research. : 
Portrayal ‘supplements traditional. reporting by utilizing subjective, 
anéciotal, or impressionistic information, in an appropriately 
. communicable form, to enrich the description of program transactions, 
settings, and outcomes. Tt is distinguished by a sensitivity to 
unusual effects. and atypical results and is primarily concerned with 
proyram transactions. Portrayal is more than. description; -it-is 

- expected to be dynamic, creating a new reality or surrogate 
_experiens e which allows audiences to obtain exposure to and d 
‘understanding of program transactions. In this paper, excerpts fron : 

‘ pecent examples of program portrayals are used tovtllustrate ‘the | . & 
‘characteristics of this tectnique: participation of the evaluator; 
expectations; unobtrusive desiqn: use of coyntextural description to f : 
stimulate reflection, empathy, and understanding; and attention to 
action, chronology, and stege setting. The implications of portrayal 
‘aS a ‘personal reporting stvle are also discussed. (BW) 
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. and administrative agencies. These changes, often the result of changes 


~ - — a 


US DEPARTMENTOF HEALTH, | 

- EDUCATION WELFARE - - 

a “ NATIONAL INSTITUTE OF | 
‘ EDUCATION , . 


vy, 
%. . THIS DOCUMENT HAS BEEN REPRO- 
. DUCED EXACTLY AS RECEIVED FROM 


me ; THE PERSON OR ORGANIZATION DRIGIN- 
P . ; ATING IT POINTS OF WIEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRE- 

SENT OFFICIAL NATIONAL INSTITUTE OF 

EDUCATION POSITION QR POLICY 


PORTRAYAL AS A WAY OF ADDRESSING PROBLEMS 
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IN COMMUNICATING EVALUATION FINDINGS* 
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The evaluation.of educational programs has in recent years been . 


altered appreciably by changes in the informational needs of funding 


in the locus of control, have led to increased interest in the descrip- 
tion of educational programs and associated transactions, Funding agen- 
cies, now often hundreds or thousands of miles from program.activities, 


seek understanding of program transactions. Distance inhibit? knowing 
- Sea ; . 
what the program is. oe , i é 
‘ i ‘ 
. 4 


Program participants' have often joined in the call for improved 
descriptive power in evaluative research. Past evaluation efforts have ' 
often left participants .perplexed»_ Participants have been confused by 


discrepancies between program transactions as they experienced them, 


al b . 
and the representation of these transactions as presented by the expeft. As 
: \ 


consumers of evaluation reports, program particpants need help in re~ — ¢ 


solving the dual image of reality as they have come to know its and J 


” 


reality as it is represented by experts. 
~ 
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Traditional reporting techniques have also, been criticized for. 
\ 5 


not responding to the differences in criteria of success honored from 


‘ 


place to place. While these reports purport to assess the ca Aiden 


- 


educational attivity, little provision is made for providing validation , 


of evaluative judgments across euloures and over time. Criteria df 


‘success vary from place to place and. change over time as. well. To be 


. 


valid over time and across cultures evaluation studies require broad and 
creative approaches. Assigning value to educational activities requires 
knowledge of both transactions and context. "The assessment of merit"4- 


long the by-line of program evaluation--is now often expected to encompass * 


sensitive destriptive and communicative strategies far beyond previous 


demands. 
v 


In an effort to meet the demands for more and better description, 


evaluation specialist are turning to other disciplines. ‘They seék old 


techniques, newly gdaptable to evaluation. To date, the primary outcome 


has been the reshaping of the eyaluation process inte a more eclectic 
be Ae ; me 
activity. One addition, particularly attractive to some evaluation 
‘ 4 


Specialists, is the’ conceptual model of ethnographic inquiry. 


Several specific strategies, have been suggested as alternatives 
which may generate more precise and complete descriptions of educational 
programs. One such alternative is evaluation by case study. Ina dis- 
cussion of the aims of case study, Becker (1970) stated that, _ 

In co: crast to the laboratory experiment, which ap es 


to test one or a few closely related propositions a& rigor- 
ously and precisely as possible, the case study must be 


: : prepared to deal with a great variety of descriptive and 
ne theoretical problems. The various phenomena uncovered by 
the investigator's observations must all be incorporated 


into his account of the group and then be given theoretical 
relevance. (pg. 76). 
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Others (Stake, Smith, MacDonald, Walker) have also explored case — 
study methods as applied in educational settings. As indicated by Becker, 


these aueherd suggest that a primary thrust of case study is for breadth 


<__ TS 


of coverage. "The case study. ... proliferates rather than. narrows. One 


is left With more to pay attention to rather than less. The case study 
; 


attends to the idiosyncratic more than to the pervasive (Stake 1976, pg. 8).",. 


‘ oe < avs nN * . o ° 
tase study has received more and more attention as evaluation spécialists 
oi 


display aneredsed interest in promoting understanding, of program trans- 
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actions. : é' / 
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In ened discussign of he ois theory" » Glaser arid Strauss (1967) 


addressed the issue of relating theory and data. Their goal was: that of 


generating theory rather thaf reporting evaluation. results, but their plea "a 
“ ; ‘ 


a 


for wholistic description fits the evaluator's goal too. In the same 


* 


vein Denzin (1971) has offered "naturalistic behaviorism," as "the 
4 
studied commitment to actively enter the worlds of native people and 


to render those worlds understandable from the standpoint of a theory 


, 
that is grounded fn the pabainioes, languages, definitions, attitudes 
and feelings of those studied." Denzin!s work typifies the current 
chalieige for better communication of rere tn 

* Campbell (1966) os ieeeuad another discussion of linking theory 
to data. The challenge of pulling together data from observations, 
interviews, or surveys in order to Pore a conceptual rete. is addressed 
thrgugh pattern matching. - "In the pattern matching of theory to data 
we reduce the fringe of error as much as possible, we center theory ~ 
in the data peints - that the fringe occurs without systematic de- 
viation from theory, and we distribute the fringe of ‘error. over all 
of the observational points, potentially. .. tie | anehotiaet of 


theory to data has not at all been achieved through a perfect correSpondence 


¢ 


al 


at any particular péint,: but rather through a pattern matching of the 
8 


- 


two in some over-all day (Campbell, 1966, pg. 100-101). 

In a paper _— specifically directa toward evaluation, Parlett 
and Hamilton (1972) proposed "illuminative" evaluation, .an approach 
which the authors described as belonging to an anthropological research os tg 
paradigm. In illuminative evaluation yarbeanned measurement of edu- 
cational products is abandoned for-intensive study of the program as a 
whole: Its rationale and evolution, its operations and achievements and 
difficulties." (Parlett & Hamilton 1972, Summary. ) 


Another form of. eyalust fat, educational connotsseurship ‘and edu- 


a 


cational criticism, has been suggested by Eisner (1975). Th defining 
this eiaiiaeton form, Eisner states that, "The concept. of education 
connoisseurship and education criticism is posited upon a different 

set of techniques. Connoisseurship is an appreciative art based on’ 

an awareness of the qualities of what one encounters and a comprehension 
of ‘other states against which to contrast it. Criticism is the lin- 
guistic Sheetinuure of the encounter (Eisner, 1975, abeteaKe) 

Stake (1974) has ‘suggested "Responsive" évaluatfon. He has des- 
cribed responsive evaluation as "not a new alternative (but). . -what 
saapin di naturally in evaluating ene observe and react." (pg.1) 
Stake further Sceerted that "an evaluation is a 'responsive evaluation" 
if it orients’more directly to peCeran peravae ses ‘than to progtam intents, 


if it “responds to audience requirenents for iseceuaetens and if the > 


different value perspectives present are. referred to in yeport ing the 
-> 
syccess of the program." (1974 pg. 1.) - 
Kemmis has synt esized the work of Parlett, Hamilton, and Stake 


by emphasizing the realities created by evaluation reporting. . In 


® 


: a4 | < : ° 
reaction to traditional statistical ‘reporting, Kemmis warned that the 
“bare skeleton. eck cold and unyfelding to the technically inexpert ~ 
eye... ss ? ae et ae living reality of people, 


events and issues\in day-to-day program dperation." (1974, pg. 1.) 


Common to edch of. these writings is a sense of the inadequacy Sede 
of traditional evaluation methodology. Each author has ‘proposed a more 

wnoltabte “évestanne of the evaluated activity. In sddition.+ cack ee 

lends Sasneet for a recently proposed approach to qualitative descrip- 

ehoné evetiatianay portrayal. : 

’ This paper explores program portrayal as a way of addressing the 
"60d for increased descriptive capability in evaluation reserach. | 
Through comparative analysis, important elements of several evaluation 
reports ace tacdeitted, Each ee these reports has been labeled as 
portraying an educational program. The anatase ae portrayal is’ ‘also 


‘ 


_ facilitated by comparison koe existing tradttions of evaluatidn reporting. : 


~ 
f 


& 
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Elements of the Portrayal ‘Approach . oes - / 
. Kemmis (1975) suggested that evaluation Has as eee re- 


oy 


_sponsibilities facilitating the "coming to know about" or "making 


. . F / 


decisions regarding" puncationst Programs_nd products. Portrayal, 


with its emphasis on seinen is paredeulerly appropriate for ,ad- 
~ \? 


dressing these responsibilities. It responds to Eile sof fee presen- 


_tation of evaluative results im an easily sGuiindeabiel cyte, 
; : 


Several authors (Parlett, Hamilton, Stake, and Dee have defined 


j ; 
} r } 


’ ] : 
key elements in the portrayal approach. Parlett and Hamilton (1972) avi 


for example, have extended portrayal to addrdbe the numerous ‘relevant 
' ‘ i) ‘ 
parameters which ‘characterize ace situations., They contend 
4 , | 
that in the more traditional evaluation a population parameters 


‘ 


. ‘are since taney described by. select thg Large random samples for mea- 


surement. Traditional methods, by sapeenkiabing on quantitative infor- 


mation, "can lead to neglect of other data, perhaps more salient to the 
innovation, but which is disregarded ‘as being "subjective', ‘anecdotal’, 
\ or ‘impressionistic!." (Parlett and Hanilten,, 1972,"pg. i Pe a Norereyel is 


expectel to supplement traditional | réporting by Men bietne this informa- 


S, 


tide in an appropriately rae form, to enrich the ean metad 
: of program transactions, settings, andyout cones. 


Portrayal is distinguished by “a sensitivity to eee effects and 
es 


————— 


atypical results, It is to be designed to articulate the concerns of . 


multiple audiences, to be responsive to. the range of information needed 
by audiences, ,and sensitive to the varying, conceptual styles of different 


groups. As an act of communication, portrayal relies on pluralistic sen- 


sitivity for success, ag 1 


| S, : = 7 “ oe : 
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Portrayal is further characterized by a primary concern for the’ 
description and/or interpretation of program transactions. Preparing 
for portrayal, the evaluator will be wholistic in siitanchine the edu- 
cational pEderanls Techniques which tend to over-simplify the program Ro Re. tat 
are to be avoided. Parlett and Hamilton would describe the al cd 
against the backdrop of the “instructional SySEER: or "learning milieu." 
It is _assumed . that the program, its setting and constituency combine to for-_ 
mulate a complex interactional system. Thesevaluatox! s task is to "un- 
ravelit, isolate its significant features, delineate cycles of cause 
and sefent and SOMDEBHENG, relationships between beliefs and practices,’ . 
and ne otganizational patterns and responses of individuals," 
(Parlett and Hamitton; 1972, PB. 16.) . 
“2 : theese who attempt portrayal can be expected to give attention to te 
. inkotmatiton Sarhientag at the wencnaw “ok decision making. Documents, ‘ 
beliefs and practices take sienedent jvee fhgasurements. Ultimately 
portrayal may aid more in rational decision making. ‘It stimulates 
insane the abi eet rather than its measurements, — measurements, 
unlike experience, are discrete; Hanteavats: howdvets ae to pre- fk 
serve the cont inuous ature of reality. 

Several writers caleaial Hamiltdn, MacDonald, and Kemmis) have 
expdtted the evaluator to - iterative in his’ SEPP OREN, ‘constant ly f 
. checking and verifying inform&tion and perceptions. As the {past 4 
gation unfolds, problem areas become clearer. the potttayal suatiatoe 9 
builds upon an exparfding record of shaaeebtones Their natn forte is ” 


\ 


interpretive human insight, implemented through participant .observation ; 


as well as other naturalistic techniques. 


Foktrayal ip more than simple dace ethan: ap a5 expected to be 
dynamic, creating a new io rani or surrogate experience which allows 
audiences to obtain exposure to and understanding of program trans- 
ition 

The portrayal - ‘process is. evolutionary, pat as ‘tt grows, it develops; * ’ 
becoming more focused, more Acgetinviee. Aggording’ to PEAKES “issue- - 
questions bacon the core of investigation and are revised aniee re- 

Placed as the investigation proceeds. Such questions are "sources of 


, rd : 
insight for the portrayal maker: they are the foci around which the - 


themes can be stabilized. They have special power because they recog- Z 
nize what participants regard ag, the key issues or ideas about the pro- 
gram and because (in’ starting from the concerns of audience members) 
a : 2 : 

they provide ways into understanding the program for the portrayal au- 
dience." (19 , ee | | | 

For Stake (19720), "What many clients need is a credible, thorough 
representation of what the program i¥, including information about who % 


likes jaiat ghowk it. Clients need-confirmatfon of what they know 
reminders of things they are’ overlooking, and something in the way 
‘of a report to siti other people. It is difficult for many clients 
to perceive the scope and movement of the program. . - If the program 
glows, the evaluation should reflect sous we it. If the program wobbles, 
the tremor should passé thfough the evaluation report." (pg. 3) 

Though it is yet an infant much is expected of portrayal. The 


long list of expectations summarized here reflect that clearly. Por- 


, ‘ 
( 


trayal is in fact developing as its practitioners obtain'more and more — 
experience "representing" educational programs. New modes of expression 


' are being developed to allow the evaluator the flexibility required in 
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+g 


portraying complex educational programs, _ The portrayal-bound evaluator 


is charged’ with responsibility for explicating mdltiplé realities, dis- 


: ; a ot? a 
‘playing nuances of behavior, and simultaneously weaving a 
a a 2 


descriptive 
reality héretofore seldom delivered in educational evaluation, By \ 
building a shared ea eereP aad between author and reader, the por- 
‘trayal writer seeks to fsetditate Hie denser ant disparate anaes 


to provide surrogate experiences for those too far ‘for -intimate involve-- 
; : ; ? 
i te 


ment; and to honor the varied criteria of success held by evaluation au- 


diences. 


pay 
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Excer ts Paekecne Examples oe Por ai 
Much of recent aT BeNSeLOn regarding the potential and eepientic ; 

‘ of portrayal arenes seta superiority of portrayal over more lati 

approaches to sasstrige, These arguments, couched in disapproving - 
| dewcdinnke regarding other approaches, have dona auch to imply an 

fieonaat pila a be tween portrayal and traditional eee An 

analysis of portrayals themselves, hedavens yields no such ineonpat- 

ibility. A review of existing sartrivals demonstrates, that portrayal 

iieutta to an increased awarenéss of and sensitivity to the nature of the 
spatgae Bhjeete Advocates of portrayal need not promise to replace 
or invalidate traditional approaches; the SOWRELUU LEON of : ‘portrayal Ys 

a real. and discrete addition to current evaluation practice. Portrayal, 


we , 


“an act iit description, analysis, and interpretation is perhaps--it will \ 
‘be seen--most importantly, an act of communication. 


; Several’ evaluation reports which eortiay" educational programs have 
been identified by Stake (See appendsx A). These "HEERE. are not a complete 
ieaahae of portrayal, but they represent sich: of its bbetaaivie 
Early portrayal authors have critiqued their work for spontaneity, : \ 
errs and’ validity of inference and observation. The taal isa 
difficult one. Traditional dependence on psychometric methods dies 


hard. It is true, however, that whereas much has been asked of protrayal,. ? 


yA : . 
dand even more promised, existing works so labeled have made a real and 
: P) 


distinguishable cantribution to the problem of cottmunicating program 
transactions. There remains a need for careful delineation of those 
characteristics ;of protrayal which provide the basis for its success. 


age 
1 


Pow ‘ . SGad . . 
In reviewing several of the.works cited by Stake as "portraying" an 


educational, program, numerous styles were observed. Yet, whén taken 
‘ , ’ ‘ P ; Ld . \ : 
comparatively these portrayals displayed several ,common characteristics, 


which provide guidance to the would be portrayal author. Much in the 


. . 
¢ r 


same way that the nSErenY styles of prominent writers. influence young ew 


developing writers, the descriptive achievements of contemporary 


portrayal authors are eesinced here for. guidance. ‘Attention is partic- 
‘ : , : r : 


ularly being paid’ to techniques used to preserve the "real life" 


qualities of educational programs. 


. Participation of the Evalueears Be portrayal, the evaluator may choose 


to be bene active or passive, but is always” at ‘least a covert partic- 


i. Sank Portrayal writers may facilitate the interpretation and/or’ 

validation of their, work by extending the sae piaigdat anaseiee role 
from data collection and analysis igto. the report writing stage. sa ead 
as a PEREESE REDE in the report narrative ,/the evaluator is “abte to oo \ 
reflect expectations as they ‘developed during program transactions. & : 
by painting the author into the images created by the report, the | 


natural skeptictsm of the reader is put to work oo a validation process. 


The sealudtae serves as cereaiany ea iiei describing program transact{ons 


“i as ff they were presented on a studio monitor. Validation is hente 
advanced because the statements of the evaluator define a “stage presence" 
| with reRpect to the object portrayed. tha poneeayal author may move in 
‘and out of the activity puported, tiluseratiag which activities he/she © 


has particulat knowledge of, or experfence with, This is accomplished OT A 


by. laying out other elements ina more distant mode of presentation. 


ag a 12 


Through this continual partictpation “of the evaluator feashier as an’ actor 


ér narrator), the reader is oriented to the evaluator" s style, preferred | 


mode of delivery and the relationship of the evaluator to the auttons 


) 


Jim Schott and Mary Lee Smith haye fitueekaved this  bechidaue: in 
- "Paridetpant Observation . Outward Bound." This ‘statement appears as 
“ ‘ ° 
part of an Evaluation of Outward Bound. In the participant observer’ 


‘statement, Jim-Schott introduces the reader to the outward bound program, 


‘and to himself as a participant narrator. In a section headed "Expecta— 


| ee 
. 


tions" the author sets ‘up his participation, elements of the program, and 
something of his personal perspective as his participant narrator role 
begins. - | F -% ee : 


Expectations 


‘ 


- 


. 


and to do to me. I was aware 6f its military origins and the 


points are important as further analysis and description is attempted. 


G- ' es 


The six-hour bus ride from Denver to he: San Juan: Moun- 


‘tains let our fears and expectations incubate. My own feats: 


centered .on the age difference between myself and my fellow 
Outward Bounders. - -I guessed that I was twice as old as ‘the 


rest and wondered if their strength. and endurance would sur- 


pass mine. The prospect of failing physically and-being a’ _ “igh 3 
social outcast was cheerless. Like the children around me, 
I knew something, of what Outward Bound was supposed to ‘be 


rumored physical danger of thé: rogram. There was also: the 
intimation that one would expérfence the mystical entry into 
adulthood, Although I had long since entered adulthood, cer-, 
tain aspects of myself raised doubts about the coming 23 days: 
my fear of heights, my inexperience with competitive situations, 


my intransigence when pushed. The doubts were repeated mental 


questions, Would I be left behind? Would I panic half-way up 
some steep rock face? Would I fall into an adult role, take’ ‘ 
too much responsibility and be rejected? Would I quit? My \ 
confidence was low and my anxiety high. ‘The silence on the 

bus led me to believe that the others were, also ruminating on 
the experience ahead. We each had our own private visions and 
nightmares. (Schott and Smith, 1973, pg. 24.) tev 


The evaluator's age, self-concept, and’fears are included'in this 
example of stage setting. The reader can then get an idea of the persy ° 


‘pective from which the participant observation data is gathered. These ~ 


’ z wall, 
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For several members é6f the patrol almost every day was 
' spent pushing farther and faster ’than they thought themselves 
able. - For others, the slow pace taxed their patience rather 
‘than their endurance. I was fatherly and solicitous of the 
slower members so my impatience never showed. The people 
who urged-us‘to a faster pace on one day might be the one 
with blisters or a wrenched knee the next. Enduring pain 
was just as much part of the physical challenge of Outward 
Bound as was moving faster and farther than one wants to go. 
We began to experience the physical rewards as well. Physical 
exertion brought on feelings of exhilaration and well-being? - 
' \ (Schott. and~ Smith 1975, pg. 27. aa 


In this particular’ evaluation, | the range of experiences held by 
repanbeat pants is assumed to ic widely. Eth outward bound student comes 
away with a ave set of depebicuées and a iteterent eval- 
ahton of outward bound's value. Obviously the participant observer 
cannot change: roles” depearediy in an attempt to capture the range of 


“phawe RPERLENEETs but the outward bound report illustrates {pened sam- 


oy pling. of these i il Siiouet the eyes of the Shaeivens 


, Our patrol was brok n ‘up and I became roouainead with 
six new people. The co#fortablé niche in the old group was 
gone and I missed ft. e ‘boy who was designated leader im- 
“mediately repelled me,’ I believed that the instructors placed 
‘him in charge beacus¢ he .was incompetent and needed the expe 
rience. He made sev ral crucial mistakes, The others: weren't 
much better. There was Leslie who carried the newspaper clip- 
-ping of her debutante ball. Jim, a military brat, bragged ins 
cessantly about his possessions. He could. do nothing with con- 
viction, changing his*mifd and leading us all off course. Then 
. there was Jerry who, after 20 ‘days of Outward Bound, still had 
, difficulty with maps, stoves, and tents. (Schott and Smith 
1975, pg. 38.) - Se _ 


Other portrayal writers have used. different ees illus- 
* é : e : ‘ 
trating the vantage point held. during observatioh. As illustrated later, 


field notes may be included in the portrayal to. reconstruct eventa, (or 


photography. may be used, Whatever mechanism is employed however, por- 


“trayal authors gain-much by including themselves as,a part of the por- 


trayal report. ° 


my 


_ The\authors explain: 


t- S aur ae " 
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» Unobtrusive Design. The strategy of portrayal places great emphasis 


on representing programs completely and accurately. As a result, it is 
important that the investigation be as non-reactive as possible. There 
are no control groups; hence the effects of data collection procedures 


cannot be. parcelled out, either in terms of outcomes or process. A 


‘ portrayal therefore would look closely at events, actors and settings-- 


wy 's 


yet seek some comfortable, compromise between rigor of investigation, 
3 Fs ‘ : . 


ri¢ghness of data, and the problem of interferring with the prograth being” 


‘ evaluated. . ~ . e 


Interferencesés minimized byusing data cellecead from various sources 
and through a variety of techniques: ‘Triangulation of data sources and 
collectiom strategies increases the confidence which can be placed in 
data that are independently not ae powerful as siesetmpatal measures. 

In describing data collection cephades used in iiipcaneatnebe Problems 
in the Wellesley Milieu," Faction (1975) states.that, | id ‘ ; 


The methods of illtminative research vary with each 

study, defined by the nature of the problem rather than 

by adherance to a canon. The Wellesley study entailed 

small, carefully minuted discussions or interviews with 

over 80 college members (students, faclTty, student ser- 

vices and administrative staff); numerous other informal 

conversations over coffee, beer, tea, coke, ‘or sherry; 

visits to residence halls, classes, administrative offices a) 
and attendance at a variety of special functions — from . 
registration to graduation. I also became a compulsive 

collector of college documénts - committee memoranda, 

publications, news .bulletins and the like. With over : 
fifty visits to the college campus, over 500 pages of in- | 

terview notes, and a minor BE of documents to hand, 

there has been ho shortage’of things *to write about. (pgs. 

i-ii.) 

vs, te 

Smith, Gabriel, Schott and Padia (1976) combine narrative pogtEaynl 


+ 


“and quantitative approachs in their evaluation of the Outward Bound Program y 


& 


. “a a | 15 


~ 


Our sense of value is affected by both types. of por- ‘ 

trayal. “As evaluators, we lean toward the quantitative when 

_- we are confident that we can anticipate: the decisions and the 
questions that need answers. We lean toward the narrative 
when our sense of what matters is tenative and evolving. -, 
Taken together, the two descriptions of Outward Bound’ in this 
evaluation offer the reader a contrast in textures: a tightly _ a 
woven  experiemtnal report to filter out hokum and self-decgp- ° 
tion; a loosely woven narrative that captures the eingular and 5 
unmeasurable. (pg. 400) ; gh. 5 


. - Se 


~' ” "Stake and Gjerde (1971), used yet another technique to offset the 


- * * ‘ 


~ : . . ® 


"presumed weakness". of the more subjective portrayal apptodch. Their 


report, "features an advocate's report and an adversary's report, sum- e 


marizing the most favorable arguments in support of the Institute and - 
the othe? summarizing the most damaging criticism, | The reader is, left . ; 
with responsibility of Ceieace these tonf licting arguménts." (pg. 2) | 
Although each of these portrayal authors has used different tech- 
niques, the similarity of their chotsas comes from the principle of max- | ' 
otiedne the power of data re utilization of multiple sources and 
collection techniques rather than simply relying on ice laeat controls 


and post hoc statistical manipulations. 


wy 
: Use of contextural description to stimulate reflection, empathy, and 
understanding. All evaluation reports are obligated to attempt, the , . 


_ identification of important contextural elements. Understanding the 
program requires knowing something of the constraints, rewards and pres- 
sures under which program transactions occur. The teporting activity may 
involve the description of schedules, setting, primary actors, weather, time 

‘ of ibe any other ‘element of possible importance to program transactions. 


It may involve impressionistic, factual or photographic representation of 


context, but it serves to anchor the analysis, to establish the "bounded 


. e ° 
case", 


’ The writer may wish the boundary of this case to be the result of 


negotiation between writer and audience. Through preliminary presentation 


16 

of his/her interpretations, to program personnel, the portrayal may be 
injected with reality, or at least first order, primary interpretations 
of reality. By being iterative and‘ involving participants, they share 


responsibility for validating the narrative and interpretations -included 


therein, 
ss In providing a surrogate experience, portrayal data beckons the ( 
reader to become actively. engaged with the transactions. Met aphogical 


style, attention to’ specifics, and full description each serve to elicit 
responses in the reader, similar to those experienced by participants... 
Such activity: on the part of the reader heightens empathy and ynder- a 


Ud 


an evaluation 


standing. ‘ 


In "Education, Technology and the Rural Highlands," 
of computer assisted learning program, Smith ang Pohland utilized field 


. E / 
notes to relate specific actions and preserve "reality" in the evaluation 


‘ 


report. Their field notes for 10/24 read: 


Midway through the motning I happened to notice three 
boys working on the terminals.. They made an effort to start ; 
together, and it was a real contest. It should be noted that 
the three boys were not on the same lesson. Nevertheless, 
there was a great deal of: competition to see (1) who would 
finish first, and (2) who would get the highest percentage. 
The boy who finally did finish first raised his arms. above 
his head like a boxer's and crowed rather exaltedly, "I 
won, I won." -The sveet smell of success was even greater 
when he found out that he had achieved a higher percentage 
score on his test than either of his two buddies. Both of 
them looked a little bit crestfallen, particularly the boy 
who ended up last." (1974, pg. 31.) 


This quotation is part of a section describing competition. This 
sate Sari with which many readers could empathize, involves the reader 
by eliciting memory, of diate responses/in similar situations. This yee 
lection further enhances understanding 6f the cevvent event. As this oc- 


curs, the experiences of program participants are successfully transferred 


4 
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’ 
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from their soured (the three boys) through a conduit (the author) to 
an ne (the reader). is A 
Stake and Gjerde provide contextural description by deseribtne 
“Monday, July 19: A typi€al day at the Institute." _ Each of these 
techniques serves ‘to catalyze the readers re eee of the program 
by identifying relevant context. Yet this is accomplished without 
codifying or reducing the complexity of the setting. — ; ie 
Olsen's (1973) oe of captioned photography is another example 


"of the. reconstruetion of program transaétions. Stake and Gjerde also 
approached this chvougt the inclusion of student poetry asd. ueabaante 
| in’their. attempt to venundépuek for the reader the actual paraphernalia 
of the program. This may akso be accomplished through statements from 


evaluation staff members, direct quotes from field notes, responses fo 
, 4 : 5 ’ . ' 7 
sevncuiead interview protocols or questionnaires, or the use of qutside 


\ 


testimony. 7 Vis « 

‘This reconstruction is simply another method of providing linkage 
between the re author and audience. Heve participants, staff, 
evaluators or others, needene something which communicates their per- 

; noua way of yadeing, experiencing, or feeling the program in order that 
there be maximal potential for the audience to personalize this exper- 
fence. The augience then by relating to personal past experiences, trans- 
fers program experience from the actual participant: through a euneible 
surrogate experience into their au nbvbonal frame of reference. 

An example of this reconstruction can-be found in the participant 
observer's report contained ie "An iestuation TCITY." Here Ben Stake, 
a member of the Wilderness Leadership Class’ of the’ Institute speak to 


re sae 


' the learning opportunity of the Institute. —— . 


: ’ 


F : RO x 
3 As 
. a ? : 
Students will earn, even unddr adverse conditions: On 
one occasion after a nearly sleeplass night under a non-rain- 
proof shelter, a friend came to sit-but the rain under my dry 
shelter. He was in low spirits and ée plained to me he was not 
« learning what he wanted to. He said that he was learning what . 
was wrong, but not what was right. But\we figured out his 
teachers were not ttying to teach him the answers-they were 
trying to teach him the questions, And &ven though he said he 
didn't want to, he was learning. . They kekt putting him in situ- 
ations where he would learn. (Stake and GYerde, 1974, pg. 16.) 


. 


; The author here elicits prior perience of\ the reader to aid in 
describing both the learning el ieientaee ea an axample of how he came 
to understand these opportunities, \ 

Attention to Action Chronology and Stage Setting. In creating 
its reality, the portrayal will probably siplaaten the bereelatadasas 
of transactions. The author ae use a narrative style to \string together 
related events. Such activity adds to the two dimensional jescription, 

a three dimensional "presence", The portrayers Berke to set NP a inter- 
play between the background (context), foreground haces and\ important 


charactets. This again is done through stage setting. 


One example of stage setting may be found in Smith and'PohlanW (1974, 
* . “ ; 


es ea ‘ , 
From field notes the authors recorded: -_ 


PB. 26). 


. ‘Gail was extremely conscious also about people \ 
seeing her work. She waited until there was only \ 
one person in the room before she sat down at the \ 

, terminal., (Typically, in this class, children were \ 

set ‘up in groups.] At that, she covered the print- 

out with her hand and forearm'so that no one else \ 

could see it. When she caught my glance, she imme- 

diately spread her fingers apart so that I could 

not see it either (10/22), 

> ; 

This passage describes something of the setting and the action, while 


also illustrating the author's relationship to the action.’ 
¢ 4 r 


« 
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. In portrayal, as the demonstfated ingerrelation of actions creates . 


the "presence" of reality, the chronolog ai presentation of- these events 
creates a further impression of linden) providing rich description. 


Stake has referred to it as the /'whole c loth" of an éducational program. / 


o 


When transactions are presented as threads of a narrative, the events des- 


, f 


cribed take shape in nie literary senseq The event becomes something the 


vewdne can describe again and again, a .Hlart of the reader's experience. : s 
Not the same as if ia had parPicipated, but much warter and more complete ~ .~ / 
than a-statistical sumary. : c 5 
Consider for éanpie Brauner (1969 = he describes an airlift of ds 5 ys 
project participants. : 
From over the ridge the beat of ee! chopped away at the r eS 
remaining mist. ‘As sky opened the |turbo-jet helicopter swung in, \. 


trailing a 55-gallon drum of fuel at the end of a long line. It 
set) the drum between two logs as Heaeey as a woman might place ‘a 
vase. The lift was on. 


In groups of four’ and with three additional uitts of 20 back- 
packs hung in a cargo net beneath the machine, the base camp went 
to the glacier, The flight up became,a personal experience from 
the moment of lift-off. The machine skimmed off the meadow, cir- 
cled inside the basin, and darted through a gap in the peaks. 
The lush Alpine meadow dropped away into rock canyon stripped of 
vegetation, The helicopter came up to'the 500-foot face of the 
glacier at 120 miles an hour, slipping between clouds and ice like 
a razor parting fissue{ Racing across the frozen ridges of snow 
that spread all around like a still ocean brought the full fasci- 
nation of speed up through the glass bubble. As if’ about to topple 
over a crest that dropped half a mile, the machine floated into a | 
stall and touched to a stpp. Set down at ‘an altitude of 6,500 feet, 
each new arrival looked from the rough crown of encircling peaks in- , 
to the abyss. (Brauner 1974, pp. 81-82,) 


Skimming, circling, darting, slipping, racing, floating, and logking, 


each action in Brauner's description builds on those prior.. Together they - 
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\- 


elicit the essence of participant experiénces. Little falls between 


‘the gaps in this description, each action grips that before it as all 


are woven into a composite description,. the "whole cloth". 


e 


Contrast is of course a main element of description and hence is 


maximized in portrayal. Contrast is further a strong element in defi- 
e\ : 


nition, The surrogate experience is enhanced by the drawing of internal 
contrast, since events decribed-are then anchored in the mind of the: 
reader, In discussing "the mode" Brauner states (1974), "Mueh was 

Lf . , 


ee nf 
made of the positive feature of people, places and events, ,The nega- 


tive aspects of industry slums and attitudes were set cut in sharp re- 


‘ lief." {ps 97) 


» happened an 


The portrayal format is a catalyst fox extreme variance in literary 
; e 
style. The portrayal focuses on actual and specific events, transactions 
or ars Its narrative might include a detailed recounting of what 
to whom. Here the process orientation is in contrast to 
that outcome orientation of mee traditional methods. This. process 


orientation seems to have a natural need for literary and/or interpretive 


reporting. The final report attempts to recreate the unraveling dimension 


of actual events. Summarization must be redirected so as ‘to protect the 


integrity of some of the smallest discrete behaviors. Preservation of 
the ee A of action is a primary objective. low does vivid lan- 


guage foster the illusion of action? Brauner, (1969, p. 96), for example, 


* > 
presents a taut, vivid description in "The First Probe". 


- Quite beyond themselves, the crawd did not notice the 

next stage until the strobe light set out a pattern of flashes 
that resembled the cannon blasts at the siege of Sevastopol. 
All motion was frozen in a series of disjointed stills and the 
roar of artillery came over the powerful amplifier. A rock and 
roll band of amplified guitars and rim-rattling drums opened a 


el 


‘light show. On a parachute, held up to the curve of the dome, 
projectors flashed subliminal imgges in quick succession and 
overlay. Color blazed sae the smoke and splashed along 
the silk like dry dust cast by a contemporary Jackson Pollock. 
The blinding flashes of light showed the Byrations of the dancers 
into a slow-motion satire of a Chaplin film, And throughout the 
dome the ear-splitting roar of the band pressed as thick as an 
invisible fog suddenly turned harder than steel. Frozen in fran- 
tic postures by the flashes of bright and black, tly were held 
here motionless by noise so stunning it solidified the very 
blood in their veins. It was:the light, the black, the blindness, 
he deafness, the start, the stop, the roar, the numbness of Cre- 
ation. And it went on until dawn. (p. 96) 


_ By coatrast, Stake and Gjerde (1971; p. 6) described a d&y at TCITY: » 


| Around 8 a.m, students started gathering in the bus area: 


the Sesame -II class and combined French and German classes left 
for a Cannon River canoe trip with Wilderness Class guides. 
Rest(of Wilderness Class left for Isle Royale on an éight-day 
backpacking trip. Biology classes went to St. Paul Ramsey Hos- 
pital for a series of physical tests. . About 8:15 or 8:30, ot 
classes started in classrooms on the Macalester campus. Most 

of these classes took a short break about 10:30 and then continued 
until 12:00 or 12:30. Fifteen students started on a bike trip a- 
long the Mississippi River at 11:30. Sometime during the morning, 
Basic Computer challenged Environmental Accounting to a volley- 
ball game. A few students played tennis, frisbee, softball, and 
went swimming later in the day. 


After classes, eppanénte in the chess tournament started 
finding each other. At 1:00, Dr. Mitra demonstrated the use 
of acrylicsgand math students began constructing a geodesic 
dome, At 2:00, Avi Davis' dance class met in the old gym, Art 
rooms were busy with painting and pottery; astronomy students 
were grinding lenses for their telescopes; a few science students 
were finishing their redwood and fiberglass canoes. Poetry stu- 
dents were in the office duplicating their "Broadsides" for dis- 
tribution to people in the streets, and there were other activ- 
BRAEHs 


By 1:30 most of the 150 students who stayed for afternoon 
activities on campus had departed for home except for the canoe 
builders wns BEay St till 6 or 7 in their race “against time. 


Both descriptions recreate the events ‘of the. se. though eieh very 


different formats. Olsen (1973) included a pictorial description in his 


portrayal of a 4-H camp. All three portrayals underscore the personal 


nature of the activity. 


. statements, while adding to the common ground between writer and reader, 
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‘@ The portrayal writer has the opportunity to include interpretive 


statements within the narrative of the portrayal. Inclusion of such . ” 


> 


will also yield the possibility of higher order interpretation of events 


and their Uflationships. While sch interpretation is not new to evalu- 


_Ation, it has seldom been spotlighted. If, as in Brauner's. "The First 


hy ; = ist 
Probe", the writer describes the scene interpretively as‘containing a 


"Lord of the Flies” group, the reader may wonder of the label's signif- 
icance. However, the writer in this instance - nataphorically defined 
the grouping process and identified several ae groups, the hoarders, 
the share-s, the defiler, the isolates, the raiders, the includers, the 
excluders, the worriers, the trusters, the erimblers, Thus, stating and 
substantiating the groupings, the writer exposes hints about the relativé 
seation of evaluator and object ad further adds interpretive flavor. 
This combination illuminates the evaluated object, and the evaluator's 
een eee that object. The primary difference as compared 

to traditional reporting is the conscious interpretation with deltherate 
injection of "scene-setting" interpretive statements. Such deliberate- 
ness is irae preferable to the haphazzard style most often encountered > 
in contemporary evaluation reports. ' 


One logical extension of internal interpretation is speculation 


F ’ ; hd F 
about causal relationships. The isolation and identification of causal 


relationships is the aim of many evaluative works and is legitimately 
within the scope of portrayal. Here again the causal ere actu- 
ally hypothesized may differ only slightly from that resulting from a 
traditional reporting system. But because portrayal goes oe the 


basic mandate of description, this’ causal relationship is, highlighted 
“ z 

in the write-up. In portrayal, primary emphasis is on the preservation, 

OF 


a 


— 


“s i ee 

, ; e : 

) interpretation and ‘transmittal of experiencés, actions, and eveiibe Witten 
had often been lost in the analytical nature of traditional investigation 
strategies. ' Presentation of these: relationships in plapecuiative manner, 
however, a lows a less weighty treatment of causal inference. 

Extending this iene raises the Prospect of complete specificatiogs 
dceerinttan in aan istae as to literally recreate program activity, 


r 
Smith“hnd Pohland,’ though not going to that extreme in epreidicakion, 


move beyond Braunetito @ a more traditional anthropological method designed to 
“recreate” transactionsthrough full description. fhiese authors utilized 
~ field notes, a focus sorautineeauad behaviors, and organization (fnto the 
smallest meaningful units) of issues, findings, ae ae generate both 
‘theowy and presence. 

Here the presented surrogate experience becomes that of the evalu- 
ator rather tyén exclusively of the progran participant. There is a very 
smooth yet significant shift implied in this new orientation. The more 

Literal and detailed, but detached desertation referred to here still 
seeks to provide the reader with a surrogate experience but the timing is 
moved forward. The reader comes away with a view of the program and its 

- eranisactions: but a view revolving around the evaluator's encounter with 
program elements, in addition to participant reactions. oy 

eeu Ee these characteristics conecibike to increased awareness of 
the aveliiated object. They wee up the basic thriist of the entvteval 
strategy, while fotgely outidietad implicit standards. In isolation, how- 
ver, théy can never capture the complete flavor or potential of portrayal 


canmiionk Portraya @s an act of communication is very situation specific, 
= 7 ‘ 


The aboye characteristics while broadly representative of current practice 


do not of themselves equal portrayal. 
%, 5 . 
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Implications of Portrayal as a Personal Reporting Style 


Movement towards portrayal involves a paradigm shift which has im- 


_plications for every facet of the evaluative study... Portrayals are nec- 
essarily'a very personal thing. Regardless of how iterative and respon- ese 
sive the approach or how triangulated the design, the portrayal still 


represents the personal involvement of the' author with ‘an educational 
program.’ ® ae ase no é 


te 


As a result of viewing the author as object and subject of his work, 
introspection becomes a pivotal activity in the portrayal process. Denzin 
suggests that the observer, "Can treat self as a third-person object, "Tt 


placing self in a collective:group and noting how ‘they’ acted. She or 
% 


he ‘can introspectively take’ the role of a second party, inputing motive to 
a wife, daughter, or colleagues. "And finally, she or he can treat self 
in the first-person sense." (1971, p. 180.) It is this introspection 


which greatly eianees scene setting and interpretation, and provides a 
challenge to participatory evaluation. a . 

One challenge of participatory evaluation lies in .the reduction of 
personal ines the evaluator's underlying ideological or sai ossanawale 


bent plays an important role in shaping the portrayal produced. Subtle 


‘ 


cognitive imagery as*well as idiosyncratic liasions and preconceived * 
notions of the proper order of things, unavoidably restrict the range of 
the portrayal. The reduction of bias depends in part on the portrayer's "ee 


ability to describe his inter&ction with’ progrdm components, In* addition, 


‘ 


however, the author utilizes triangulation of observation to support ma- 


, 


2 


jor propositions. 


s 
¢ 


In triangulation, the evaluator focuses on contextual material to os 


anchor observations. Observations are analyzed for their timing, 


¢ 


sequencing and consequences both with respect to primary actors ne 
cluding the evaluator), and important aspects of the setting. One a 
portrayal's atvengtlis is the relating of primary observations to the 
setting’ in whi they occurred, and the ene anietes or outcomes they 
eeporbediy elicited, 

To avedase a well-reasoned analysis, propositiqns ‘must be aunanieas 
in data. .Portrayal authors therefore, must attempt to impose creative 


ténsion between the interpretive reality of program participants. and the 


more theoretical, 4nalytical, constnictions they generate. This tension 
facilitates ie author's penetration into che evaluavadl peburane exposing 
the internal mores and forces which phahe participant perceptions. Care 
‘must be exercised to settee all verifiable perspectives. Only when in con- 


tradiction with other findings can a respondent's account of prograt set- 


. 


ting, transactions ‘or outcomes be discounted. . o 
To maximize the validity of Setigralteattons within the bounded case, 

the sobinatos seeks to construct observation schemes which reflect see 

. behaviors of program participants. Care is enercieed: to avoid imposing 

an order on’ program transactions simply to facilitate data collection. 

The distance iebewien eee and respondent cpoeentiel frameworks should 


— 


also became an explicit portrayal component « ee ong 
“The protection of some notion of chronology within the description 
often supports understanding program transactions and reduces the heed 
for Eusuwveed conceptual schemes for daca sviababl, It should be noted 
however int this chronology in retrospect may inpty an orderliness not 
obvious ities ‘ongoing program activity. The portrayal should seek to 


avoid oversimplifying these elements and must place a priority on pro- ‘ 


viding an accurate account of their relationship to the program as it unfolded. 


°6 


r 


| analysis of unfolding events draws on the patticipant evalu-. 


ator's ability to reveq} at least one side: of the (normally covert) di- 


“atoning with self that generate. participant behaviors. " Svontaw events 
traditionally analyzed for predictive power, are now ehuced as holding 
interpretive power in and of themselves, It is ehens events which em- sR 
*pirigally seoiid the causal propositions the portrayal) contains. 


In traditional designs these propositions are generated by stan- - 
dardized methods producing a guise of griectivity which’ has been called 


into question. Portrayals, to be an alternative, would cast the eve LeS e! i al 


‘ator in a responsive and 5 ha role irf order that the concept of the woe 


audience's decision mdeing vacant ue eadipatea. If the audience 
is able. to sense the interaction of evaluator and program, it has the op- i 


portunity to short-circuit biases of the evaluator. j 
| “Tt becomes the responsibility of both evaluator and reader to crit- 
ee analyze-reports for recurring themes. Enough of the program activ- 
ities should be represented that the audience may venies wine Caen 
ably not all) of these themes and thereby guage the evaluation results 
for ChERSEL VER: . | 

The problem of “Gdeological bias is ‘BeRravated by the "position" of. 
the évaluator-with respect to the program. Typically this problem results 
from the eenettomine of the evaluation effort.. ‘It may also- result ‘from 
distance between evaluator and project. Typically, the evaluator is 
brought in by the funding agency or the project directot. In the former, 
the sanctioning of the evaluator comes not only from outside the program, 
but also in a sense a above the program administratively. In the latter 
case, the sanctioning can be maltiple in that the evaluation may be man < 


dated by contract, but supervised by the program director. In most cases, . 


. ‘ 
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however, the evaluation will be viewed as an extension of the sanctioning 
body. : 
Hence the reception which the evaluator receives is in part based 
on his/her administrative alignment with the project. In portrayal, a \ 
this relationship must be described both od sinport’ ths understanding of | 
Ang aidtones and to clarify the orientation of the évaluatoy. 
Stake has reised an interesting point in his wiguestion that eval- 
uators are praised more for their methods than Tesults. Given, that this , 
is tie case, Bye eng try to sities their auvendaer methodological. 
tricks whether they apply well or not. In essence, all people are pre- 
disposed to measure what they can measure best. Specialist in evaluation 
a Gueapably better (or more practiced) at measuring. than describing.. 
Perhaps this is true because for many years they have equated the two. 
A parallel question in portrayal ‘asks whether portrayers will tend to 
deacethe that which they describe best? ‘Or more basically, that which 
they observe best? 
As a check, portrayal Sitcecs work iteratively, drafting comments 
and checking them with saekiotoaues ” Beane Unfortunately, this checking 
is an artificial situation. While it: will correct gross deficiencies, in 
the noeteayaly the emphasis for the program participant will errs r 
“be on checking the . Faulldarity ‘of points. Thus, program participants 
may see much reflected in a portrayal which they themselyes would express, 
’ and as ratify bie description not oa the basis of functional identifica- 
tion of valddtey, but rather on a false aura of completeness derived ney 


bron 


the portrayal having touched several points accurately. 


It' ig*true that problems of labeling program parts, sequencing of 


events, ordering positions of primary actors, etc. can be detected by 


program staff. While this sanalieectan does thatlenye elements of eh 
portrayal for accuracy, it does not appear to deal suffi satly with 
, the problem of ideological or methodological bias. a it is of 
concern to aint extent we can ever expect to counter balarice biases, by 
cirenlating drafts, given that a large portion of the avetuarton data ; 
comes directly from project staff. Much of what the evaluator sees, 
feels, or hears is the result of obsérving, interviewing, and sduply 
interacting ‘with program staff, Finally, the negotiation with panies’ 
ipants sets up a ‘id artificial situation, apart from the reality the 
portrayal seeks to represent. ‘This interaction creates a whole new . 
set of eeapiteas and ‘chenghote: any deseription resulting ts altered hy 
this second level of interaction. 

It is this type of bias which contributes to the discrepancies 
which prompted portrayal initially. To combat its influence, there is 
a eenbeiois attempt to demonstrate how subjective experience has influ+4 

epee” coming to eee the éducatd onal program, 

It is here that focusing on the information needs of a defined au- 
dience can pay off. Not eieniy ¥ give them what they want to hear, but 
what die can best understand. sia not nig broadens the input base to 
include additional sources, but we allows for a more coherent pattern of 

\ ghatees at various decision points in the study; BRCIEINE, when to collect 
data, where and for i long? 4 ian - 

Of course, what has just been described is also a bias of ‘sorts, bik 
it is.a conscious and documented set of decisions. It is an element the : 
reader can take into account as part of the analysis of the portrayal. 
The siaivets of: trial portrayals is also enhanced because although such 


« 


an analysis is still a tally of matched and unmatched perceptions, the 


, 


limitations of the study are more clearly delineated. 
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The Contribution of Portrayal i 


For all of the promises and demands aerseperes to portrayal, its 


real PERE ADEREH remains a potential rather than a given. Portrayals, 


See go ere 


ee 


as a rule, appear vulnerable to ane effects “ limited and undeveloped 

methods. The demands on portrayal are high. The proposition like the 
: a LJ 
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psychometric tradition is an ambitious one. In portrayals, we are com- 


mitted to relating a aynents. picture of program transactions. The sit- 


uation determines much in evaluation by portrayal, few general rules 
apply. * oeae can be prespecified. The evaluator must he committed 


not only to ‘sasnanding to audiences, but also to jrouras cues. 


It is here that the primary potential of the portrayal approach is 
4 a” i ‘ ‘* 
found. Conceptually, traditional evaluative and research designs seek 


to maximize objectivity and a corresponding philosophy of science. . 


Great pains are taken in these seqrene to promote standardization as a 
way of obtaining objectivity. The sterile manipulative laboratory image 
| | —_ 

of these designs borrows credibility from the exhaulted position of sci- 


ence in contemporary culture. Further, the associated techniques enjoy 


dl ; 
‘a romance with modern technology, further advancing the aura of scien- 


tific detachment and efficiency thought to be preludes to objectivity 


and ultimately to reason. 


Portrayal on the other -hand, rejects sterility for completenéss and , 


qnvodvempits Summarization and detachment,are replaced by informed and 


interpretive human insight. The eoneupeual result is tied to reason and 

knowing, but ssc experiential rather than detached methods. ; 
Partrayal then is a reporting style which has implications for anal- 

ysis. It implies in addition, a way of bowing an experiential/partici-' 


patory knowledge. This stance influences both the evaluation and evolu- 


tion of the program. It is this sensitivity and orientation which 


ote meee 


portrayal contributes to evaluation. As a metaphorical way of reporting, 


portrayal ushers in a new set of criteria for evaluation studies; cri- 


teria which promote the revitalization of naturalistic techniques. 


se meee 


This training and practice is crucial for the development of evaluation 
andsimproves the articulation of program settings and outcomes. ‘In suc- 


-cessful situations, the evaluation enchances the description of program 


fe 
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nuances. 


The development of this potential requires a diverse sense of 


communication in the evaluator. Though it is not necessary that the por- 
. . ! e. 
bai: 


beaver be proficient in‘ every medium of communication, evaluators choosing 
portrayal should be aware of the special advantages /disadvintexee of the 
. various means of communication. Further, they should be aware of the op- 
timal use Oe naturalistic observation techniques, interviewing and other 
communication techniques. The tatintatia used should be selected for a 
natural savesenandenee with the situation. The evaluator will want to 
take a preliminary look at the program in order to build an evaluation % 
team around situational demands, * 


at 


Only by certian fully the various methods of communication and 


observation can the potential portrayer make use of the potential of por- 


trghal approach, . A portrayal admittedly, trades off some problems for 


— 


other potengials. It trades the risk of increased bias for the pokenttat : Foss 
of fuller description; hereaunias of focus for sensitivity and depth; time 

fcuen experimental design for ‘ete: creation of a surrogate experience. 

‘Portrayal represents a risk; it is not necessarily an Spencers faster, ge 

more efficient print if fully utilized, the result will more, than com- ‘ 
.pensate for the risks, yet to not. fully utilize the potential value ot por- 

trayal is to render it iéss desirable than the approaches portrayal attempts 


to supplement. | 4 . ‘ ; 
: | F 


| ss of 


” 


eon” ag 


The ‘portrayal must capture program energy, turmoil and potential. 


A blending-of the descriptive, interpretive and speculative. It is in 
Y Oe : - Se i 

this sense that portrayal attempts more than descriptiong#Mt approaches 
: F 


Ves recreation. The task here described requires a special and complete use 


t 


of observation/interpretation/communication techniques. 


\ 
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